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ABSTRACT 

A compact Lie group G and a faithful complex representation V determine the Sato-Tate measure 
MG,v on C, defined as the direct image of Haar measure with respect to the character map g h-> tr{g\V). 
We give a necessary and sufficient condition for a Sato-Tate measure to be an isolated point in the 
set of all Sato-Tate measures, regarded as a subset of the space of distributions on C. In particular 
we prove that if G is connected and semisimple and V is irreducible, then ij,g,v is an isolated point. 

0. Introduction 

Given a compact Lie group G and a finite dimensional, faithful, complex representation 
V of G, there is an associated Sato-Tate measure ^g,v on the complex plane defined 
as the direct image of Haar measure with respect to the map G ^ C given by the trace 
of V. This measure is compactly supported and is therefore uniquely determined by its 
moments 

[ z^z^ncv = dim(y®" ® Y*^b^G^ a, 6 > 0. 
Jc 

To what extent is the pair (G, V) determined by the measure fJ,G,v or equivalently by 
the dimensions of spaces of G-invariants of 1/®" (g) ]/*®^? Certainly (G, V) is not always 
determined up to isomorphism. For example, when G is a finite group and V is its regular 
representation, the only information encoded in HGy is the order of G. In [4], we showed 
that (G, V) is not in general determined up to isomorphism by ij.g,v even when G is 
connected and semisimple. If, however, in addition V is irreducible, then the pair is 
uniquely determined by its measure. 

This paper does not directly address the general problem of when fxcy determines 
(G, y). It considers a related question: for what pairs {G,V) is hg,v isolated from all 
other Sato-Tate measures in the space of distributions on C? Equivalently, when is the 
Sato-Tate function 
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Fg,v- (a, h) ^ dim(V®'^ ® y*®b^G 

isolated in the space of all Sato- Tate functions in M^xN (endowed with the Tychonoff 
topology)? It may be worth pointing out that not every limit of a convergent sequence of 
Sato-Tate measures is again a Sato- Tate measure. For example, if (Gj, Vi) is a sequence of 
classical groups in the same series and is the natural representation of Gj, then jJiGi,Vi 
converges to a complex (resp. real) Gaussian distribution if the Gi are unitary (resp. 
orthogonal or symplectic) [2] . 

The original motivation for this problem comes from the cohomological theory of expo- 
nential sums (see, e.g., [3] Chap. 3). Suppose that t/" is a geometrically connected curve 
over a finite field F, U the curve obtained from U by extension of scalars to F, and Trf 
and 7rf are the fundamental groups of U and U respectively. Let .F be a lisse £-adic sheaf 
on t/, i.e., a continuous representation tt^ GL„(Q^). For simplicity, assume that !F is 
pure of weight zero, and that F is large enough that the Zariski closures G°' and of tt" 
and 7rf respectively coincide. Then, by [1], = G^ has semisimple identity component. 
Let G denote a compact real form of the complexification of G"- (with respect to a fixed 
embedding ^ C), so .F determines a complex faithful n-dimensional representation 

V of G. Every closed point u m. U determines a conjugacy class in G whose trace in 

V coincides with the trace of the Frobenius in T. Deligne's geometric analogue of the 
Sato-Tate conjecture [1] asserts that the distribution of these conjugacy classes is uniform 
with respect to Haar measure on G. At the trace level, this means that the distribution 
of traces of Frobenius with respect to T is given by the Sato-Tate measure iJiG,v- In fact, 
Deligne proves a strong version of this estimate, which allows one to compute any given 
moment Fcyia, h) effectively. Ideally, we would like to determine (G, F), but failing that, 
we would like to know that a finite amount of computation is enough to determine nay- 
The main theorem of the paper is insufficient for this more limited goal in general, but it 
turns out to be enough when G is connected and V is irreducible. 

The situation for monodromy of £-adic sheaves over function fields is special because 
the Riemann hypothesis is a theorem, and therefore we can achieve certainty concerning 
individual moments of nay- Suppose we have an unknown compact group G, arising 
in nature as a subgroup of GL„ (where n may be unknown) for which we can sample 
elements of G uniformly distributed with respect to Haar measure and observe the trace. 
Repeated experiments will lead to greater and greater certainty concerning any given 
moment of jJ-oy- We would like to know when they will lead to greater and greater 
certainty concerning the actual distribution fioy- 
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To understand how a Sato-Tate measure could fail to be isolated, we note that from the 
standpoint of invariant theory, it is hard to distinguish U{1) from Z/nZ when n is large. 
On the other hand, Jordan's structure theorem for finite subgroups of GL„(C) asserts, in 
effect, that a compact Lie group can be well approximated by finite subgroups only if its 
identity component is a torus. More generally we expect that a compact Lie group will be 
well approximated by proper closed subgroups exactly if its identity component fails to be 
semisimple. This phenomenon turns out to explain all cases in which a measure ij,g,v is a 
limit of other Sato-Tate measures. 

The paper is organized as follows. The first section gives two basic finiteness results for 
conjugacy classes of closed subgroups of compact Lie groups. If not known, they are at 
least variants of well-known statements. The second section proves that ij,g,v cannot be 
isolated if the center of G° has positive dimension. The proof of the main theorem is in 
the third section. The fourth section examines the question of when ij,g,v is a limit of 
distributions associated to representations of finite groups. 

I would like to thank N. Katz for introducing me to this circle of ideas in his 1985-86 
course at Princeton. This paper is motivated by some more recent questions of his. 

1. Some finiteness tiieorems 

Throughout this paper, G will denote a compact Lie group, G° its identity component, 
D the derived group of G°, Z the center of G°, and Z° its identity component. Thus, D 
is semisimple, Z° is a torus, and G° = DZ°. 

We begin with a version of Richardson's rigidity theorem [6] . 

Lemma 1.1: Let X be a variety over M, G a linear algebraic group over M, and H an 
M.-subgroup of G. Let J G G x X denote a closed M.-subvariety which is an X-subgroup 
scheme (of the constant group scheme G x X/X . Suppose that H{M) is compact. Then 
there exists a finite collection S of closed subgroups of H{M.) such that for every x £ X(M), 
the intersection of H{M.) with Jx{^) is conjugate in H{M.) to a group in S. 

Proof: Let K = J (1 H x X. By a standard Noetherian induction argument, there is a 
partition of X into finitely many locally closed strata over each of which K is a smooth 
group scheme. Without loss of generality, therefore, we may assume K is smooth over X. 
Therefore, -K'x(lR) is a real analytic family of subgroups of H(R) in the sense of [6]. Now, 
Ka;(]R) is compact for all x, so every representation of Kx(^) is completely reducible, and 
this means H^{Kj;(R),V) = for any representation V. By [6] Theorem 3.1, for every 
xq e ^(R), there exists a neighborhood U such that -K'x(R) is conjugate to Ka;Q(]R) in 
H(R) for all x E U. As the real locus X(]R) has finitely many components in the strong 
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topology, there exists a finite set of compact subgroups of iy(]R) representing all -fCa;(I^) up 
to conjugation. 

□ 

Now consider a compact Lie group G, a faithful complex representation V of G, and a 
finite collection S of pairs (m, n) e N^. If H C G is a closed subgroup, V can also be 
regarded as a representation of H, and 

Fcvim, n) < F^.y (m, n) (*) 

for all (m, n), in particular those belonging to E. 

Proposition 1.2: Given {G, V) and S as above, there exists a set S of subgroups K <z G 
consisting of finitely many G-conjugacy classes and such that for any subgroup H <Z G, 
either Fg,v coincides with Fh,v for all (m, n) e E or H is contained in some K & S. 

Proof: For each (m, n) G E, we consider the Grassmannian Xm,n of FG,v{m, n) + 1-planes 
in Vm,n ■= V^"^ ® Y*'»n^ ^ indeed, the inequality (*) is strict, then the space of H- 
invariants includes some plane indexed by Xj^^^- Let X denote the disjoint union over E 
of Xm,m and for x G Xm,m let Kj^ denote the intersection in GL(ym,n) of G and Stab(x). 
By Lemma 1.1, the resulting possibilities for Kx are finite, up to conjugation in G. □ 

The last result in this section is a generalization to compact Lie groups of Jordan's 
theorem on finite subgroups of GLn{C). 

Theorem 1.3: If G is a compact Lie group for which G° is semisimple, then there exists 
a finite set S of proper compact subgroups of G such that every proper compact subgroup 
can be conjugated into a subgroup of an element of S . 

Proof: Any subgroup which does not meet every component of G is contained in a proper 
subgroup of G which is a union of components of G. Therefore, without loss of generality, 
we may consider only subgroups H of G which meet every component of G. As G° is 
semisimple, it has finitely many normal subgroups, and if H n G° contains a positive- 
dimensional normal subgroup of G° , it contains a positive-dimensional normal subgroup of 
G. If a maximal proper subgroup H of G contains a normal subgroup K of G, then H/K 
is a maximal proper subgroup of G/K. By induction on dimension, we may consider only 
subgroups H of G which do not contain a positive dimensional normal subgroup of G. 
If K is any positive dimensional characteristic subgroup of H, 

H C Normci^ C G, 
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so without loss of generality, we may assume H = NormoK. If H° is noncommutative, 
we take K to be the derived group of H°; if H° is a non-trivial torus, we set K = H°. 

In the first case H is the normalizer of a semisimple subgroup of G°, so it suffices to 
prove there are only finitely many such subgroups up to conjugacy. There are finitely 
many possible isomorphism classes for K. Given a fixed embedding G ^ U{n), each 
inclusion K ^ G determines an n-dimensional representation of K. There are finitely 
many isomorphism classes of n-dimensional representations of a fixed semisimple group; 
each one determines a family of subgroups C U (n) indexed by U (n) itself. By Lemma 
1.1, there are only finitely many possibilities for r\G C G and therefore finitely many 
possibilities for K = and for ff, up to G-conjugacy. 

If K is a torus, H contains the centralizer of the torus and therefore some maximal torus 
T oi G° . Thus K is a maximal torus of G°, which means this case contributes only one 
conjugacy class of maximal subgroups. 

All that remains is the case that H is finite. Up to conjugation, there are finitely many 
conjugacy classes of finite subgroups of G of any given order: there are finitely many 
isomorphism classes of finite groups of a given order, and for each fixed isomorphism class, 
by Lemma 1.1, there are finitely many conjugacy classes of homomorphisms to G. By 
Jordan's theorem, there exists a constant J depending only on G such that H contains 
a normal abelian subgroup A of index < J. \i \H\ > J\Z\[G : then A must contain 
a non-central element a E G°. The centralizer of a in G is a proper closed subgroup of 
positive dimension, and it contains H, which is absurd. Thus, \H\ is bounded above, and 
the theorem follows. □ 

2. Approximating tori by torsion subgroups 

Let Z[n] denote the kernel of multiplication by n in Z. This is a characteristic subgroup 
of G. We regard the Z[n] as finite subgroups approximating Z. We would like to show 
that whenever Z is infinite, G itself can be well approximated by proper closed subgroups. 

Lemma 2.1: For every positive integer n there exists a compact subgroup G^ of G such 
that GnZ = G, and Gn n Z contains Z[n] as a subgroup of finite index. In particular, if 
Z is infinite, Gn is a proper subgroup of G. 

Proof: Suppose that H'^{G/Z°,Z°) is finite. Let m annihilate this group. Then the 
cohomology sequence associated to the short exact sequence 

^ Z°[m] ^ Z° ^ Z° ^0 

implies every class of H'^{G/Z°, Z°),m particular the one given by the extension — > Z° — > 
G ^ G/Z° ^ 0, lies in the image of H'^{G/Z°, Z°[m]). It can therefore be trivialized by 
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pulling back to a finite central extension F of G/Z°. This means that the pull-back of the 
homomorphism G — > G/Z° to F splits, and the splitting gives a homomorphism (f)\ F ^ G 
such that (j){F)Z° = G. We can then take G„ = (f){F)Z[n]. 

To prove the desired finiteness, first consider the short exact sequence 

^ X4Z°) X4Z°) ® R ^ Z° ^ 0, 

where denotes the group of cocharacters. By the long exact cohomology sequence, 
it suffices to prove that H'^[G/Z° , X^{Z°)) is finite for q = 2, 3 or equivalently, that 
H'^{G/Z° ,Z) is finite for the same values of q. The first is obvious. The second is a 
consequence of Whitehead's lemma. □ 

Proposition 2.2: If Z is infinite, then nay is a limit point of the sequence 

{/iG„,V^}n=l,2,3,...- 



Proof: Clearly 

FG,v{a,h)<FG^,vM 

for all a, 6 e N. It suffices to show that for any fixed pair (a, 6), equality holds for all 
but finitely many n G N. Let Z° = Zi x ■ ■ ■ x Zk, where each Zi is isomorphic to U{1). 
Let Xa,h denote the Grassmannian of Fayia^h) + 1-plancs in Va,b '■= V^"' V*'^^. For 
X £ Xa,bj we let Zi^x denote the intersection in GL(Va^b) of Zi and Stab(a;). As these 
intersections are the fibers of a morphism of finite type, there is a uniform upper bound N 
such that if Zi^^ has more than points, it must be all of Zi. For n > N, Gn C Stab(a;) 
implies Zi[n] C Stab(x) and therefore Zi C Stab(a;) for all i. As G — GnZ°, this implies 
G C Stab(a;) contrary to hypothesis. Thus, FG,v{a,b) = FG^,v{a,b). □ 

3. Isolated measures 

In this section, we prove the main theorem of this paper, namely the isolation of any 
Fg,v which is not a limit point by virtue of Proposition 2.2. 

Lemma 3.1: For any finite- dimensional Hermitian vector space V , there exists N such 
that for a > N, 

Fuy),v{a, a) >{dimV- If \ 
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Proof: Let du denote Haar measure on U {V) and 



K = 




By the continuity of the trace function, K has positive measure with respect to du, so if 
a > 0, 



Proposition 3.2: For all pairs {G, V) there exists a neighborhood U of Fg,v in the 
Tychonoff topology such that for all (C, V) with FQiyi e U , dim.V = dimV' . 

Proof: We have for all a the inequalities 

Fuiv),v{a,o,) < FG,v{a,a) < {dimVf^. 
By the second main theorem of invariant theory [7] 2. 14. A, if a < dim V, 

Fuiv),via,a) = a! > (a/e)". 
Therefore, if dimV > e{dimV)^, setting a = [e(dimy)^], 

FG,via,a) < (dimF)^" < (a/e)« < F[;(v^,),v,(a, a) < F^ 

This gives a neighborhood of F^y which contains only Fqi yi with dim]/' bounded above. 
For any fixed value dimF' ^ dimF, by Lemma 3.1, there exists a such that 



Thus, in some neighboorhood U of Fg,v-i all Sato- Tate sequences arise from representa- 




□ 



FG,v{ci,a) < {dimVf" < Fuy'),v'{a,a) < FG',v'{a,a). 



or 



FG>y>{a,a) < (dimF')'" < a) < Fq 



tions of degree dim V. 



n 



We can now prove the main theorem of this paper. 
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Theorem 3.3: Let n denote any Sato-Tate measure for which /x = fiG,v implies that G° is 
semisimple. Then /i is an isolated point in the space of Sato-Tate measures. Equivalently, 
there exists N such that if 



Jc 

whenever a,b < N, this equation holds for all a and b. 

Proof: Let /i = /iGo.Vb ^ind n = dim Vq. By the preceding proposition, all fJ,G,v sufficiently 
close to fj, satisfy dim V = n. Consider the set of all isomorphism classes of pairs (G, V) 
with dim V = n. We construct a directed graph on this set as follows: for each conjugacy 
class of inclusion maps Gi ^ G2 such that the restriction of the representation V2 to Gi 
is isomorphic to Vi, there is an arrow from (Gi, Vi) to ((^25^2). If G2 is semisimple and 
Gi is a maximal proper closed subgroup, we color the arrow red. If G^ is not semisimple, 
by hypothesis, there exists a minimal non-negative integer N such that 



for some a + b = N. Let E = {(a, 6) e | a + 6 < N}. Consider the set S of subgroups 
of G2 given by Proposition 1.2. If (Gi, Vi) is isomorphic to {K, V2) for some K e S, then 
we color the arrow blue. All other arrows remain uncolored. 

We consider the maximal connected subgraph F containing the pair {U{V),V) for an 
n-dimensional vector space and consisting only of red and blue arrows. The vertices of this 
graph are those in the original graph which can be obtained from {U{V),V) by following 
a sequence of colored arrows. We claim this graph is finite. It suffices to show that there 
are no infinite sequences of arrows arranged head to tail and that each pair is the head of 
finitely many arrows. The first point is clear since any decreasing chain of nested compact 
groups stabilizes. The second point follows from Proposition 1.2 and Theorem 1.3. Note 
that F contains no directed cycle since every injective endomorphism of a finite-dimensional 
Lie group is an isomorphism. 

Assume /x is a limit point of Sato-Tate measures. It is then a limit point of Sato-Tate 
measures associated to n-dimensional representations. For any n-dimensional pair (G, V) 
in F it makes sense to ask whether is a limit point of Sato-Tate measures subordinate 
to (G, F), that is, of the form fJ,G',v, where G' ranges over subgroups of G. For the pair 
{U{V),V), the answer is affirmitive. Let {G,V) denote a minimal pair in F for which the 
answer remains affirmitive. 

If G° is semisimple, then any infinite sequence of Sato-Tate measures subordinate to 
(G, V) contains an infinite subsequence subordinate to (Gi, V) for some maximal subgroup 
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Gi of G. This contradicts the minimahty of {G, V). Thus, G° is not semisimple. Choose 
N so that for some a,b < N, 

FG,v{a,b)^ f z-z'^fx. 
Jc 

If FG,v{a, h) exceeds z'^z^/j,, the same will be true for any restriction of F to a subgroup 
of G, contrary to the assumption that is a limit of Sato-Tate measures subordinate to 
{G,V). Thus, 

FG,via,b)< [ 

Jc 

and every sequence of Sato-Tate measures subordinate to (G, V) and converging to /i 
contains a subsequence /xgi,Vi, Vi = ^Igd such that FGi,Vi(a,6) > FG,v^(a, 6). Every 
term in the subsequence is subordinate to a pair which is the target of a blue arrow from 
(G, V); by the minimality of (G, V), this gives a contradiction. □ 

Corollary 3.4: If G is a semisimple group and V is an irreducible representation, then 
Hay is isolated. 

Proof: It suffices to prove that if jJiG'y — jJ-Gy-, then G' has a semisimple identity 
component. 
As 

dimEndG'(^') = dim(F' ® V'*)^' = Fg>,v'{1, 1) = Fg,v(1, 1) = dimEndclT/) = 1, 

the representation V' is irreducible. Consider the restriction of V to the identity compo- 
nent of G' . This decomposes as a direct sum of isotypic factors T^', and the component 
group G' /G'° acts transitively on the set of factors. It is a theorem of Jordan that for 
every non-trivial transitive group action, there is a group element without fixed points. 
This element corresponds to a connected component of G' on which the trace of V is zero. 
Thus, the measure jiG'y has an atom at 0. This is impossible, since the pre-image of 
under the character of F is a proper subvariety of the connected real-algebraic variety G, 
and therefore has measure zero [5] I 2.5.3 (i). We conclude that the restriction of V is 
isotypic of type W . As V' is a faithful representation of G', the center of G'° lies in the 
center of G' . If it has positive dimension, then Fg' ,v'{a.,b) is zero, except when a = b. 
This is impossible, since FGy{a,b) is positive whenever a and b are sufficiently large and 
a — b annihilates the center of G. The corollary follows. □ 

4. Limits of finite groups 
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Lemma 4.1: If G is a compact Lie group such that D is non-trivial, there exists a finite 
set S' of proper closed subgroups such that every finite subgroup of G is conjugate to a 
subgroup of an element of S' . 

Proof: Let S be the finite set of subgroups oi G/Z° obtained by applying Tfieorem 1.3 to 
that group. Let S' denote the set of preimages with respect to G — G/Z° of elements of 
S. The image of any finite subgroup is a proper closed subgroup of G/Z° and therefore 
a subgroup of some conjugate of an element of S] it follows that any finite subgroup of G 
can be conjugated into a subgroup of an element of S' . U 

Theorem 4.2: If n is a Sato-Tate measure which is the limit a a sequence of Sato- Tate 
measures of representations of finite groups, then fj, = ^g,v for some group G such that 
G° is a torus. 

Proof: We follow the proof of Theorem 3.3, using Lemma 4.1 instead of Theorem 1.3. 
That is, for every (G, V) with D non-trivial, we draw a red arrow to each [G' , F), G' e S' . 
For every (G, V) with G° a torus, we find a-\-h = N such that F^^y (a, h) ^ z^'z^ji and 
draw a blue arrow to each (G',F) obtained by applying Proposition 1.2 to S = {(a, 6) e 
I a-\-h < N}. We choose a minimal (G, V) on the resulting finite graph for which there 
exists an infinite sequence of pairs (Gj, Vi) with Gj finite, subordinate to (G, V) and with 
Sato-Tate measures converging to /i. The contradiction results as before. □ 
We remark that, although it seems likely that when ij,g,v = A*G',y either both or neither 
of G° and G'° are tori, this has not been proven, so in principle for some non-toric (G, V) 
we could still have ij,g,v the limit of Sato-Tate measures of finite groups. 
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